Dynamic Gait Pattern Generation with Reinforcement Learning*

نویسندگان

  • Mustafa Suphi Erden
  • Kemal Leblebicioğlu
چکیده

This paper presents the gait pattern generation work performed for the sixlegged robot EA308 developed in our laboratory. The aim is to achieve a dynamically developing gait pattern generation structure using reinforcement learning. For the six legged robot a simplified simulative model is constructed. The algorithm constructs a radial basis function neural network (RBFNN) to command proper leg configurations to the simulative robot. The weights of the RBFNN are learned using reinforcement learning. The developed structure succeeded in learning gait patterns compatible with different speeds of the robot. Copyright © 2005 IFAC

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Free gait generation with reinforcement learning for a six-legged robot

In this paper the problem of free gait generation and adaptability with reinforcement learning are addressed for a six-legged robot. Using the developed free gait generation algorithm the robot maintains to generate stable gaits according to the commanded velocity. The reinforcement learning scheme incorporated into the free gait generation makes the robot choose more stable states and develop ...

متن کامل

Efficient Gait Generation using Reinforcement Learning

The use of a free gait becomes necessary when walking over discontinuous terrain or when performing changes in the heading of the robot. If no look-ahead planning is possible, the free gait must be generated reactively. We present a basic gait generation strategy and a heuristic enhancement of it that results in a significant efficiency improvement. In the search for a better strategy, we decid...

متن کامل

A reinforcement learning approach to gait training improves retention

Many gait training programs are based on supervised learning principles: an individual is guided towards a desired gait pattern with directional error feedback. While this results in rapid adaptation, improvements quickly disappear. This study tested the hypothesis that a reinforcement learning approach improves retention and transfer of a new gait pattern. The results of a pilot study and larg...

متن کامل

Energy Dissipation Rate Control Via a Semi-Analytical Pattern Generation Approach for Planar Three-Legged Galloping Robot based on the Property of Passive Dynamic Walking

In this paper an Energy Dissipation Rate Control (EDRC) method is introduced, which could provide stable walking or running gaits for legged robots. This method is realized by developing a semi-analytical pattern generation approach for a robot during each Single Support Phase (SSP). As yet, several control methods based on passive dynamic walking have been proposed by researchers to provide an...

متن کامل

Design and Implementation of Fuzzy Policy Gradient Gait Learning Method for Walking Pattern Generation of Humanoid Robots

The design and implementation of Fuzzy Policy Gradient Learning (FPGL) method for humanoid robot is proposed in this paper. This paper not only introduces the phases of the humanoid robot walking, but also improves and parameterizes the gait pattern of the robot. FPGL is an integrated machine learning method based on Policy Gradient Reinforcement Learning (PGRL) and fuzzy logic concept in order...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2005